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(57) ABSTRACT 

A user interface and methods for using a user interface for 
controlling processing of time-based media files. In one 
exemplary method, a graphical representation of a time line 
for a time -based media is displayed along with a graphical 
representation of a current time along the graphical repre- 
sentation of the time line. A start graphical indicator and a 
stop graphical indicator is also displayed along the graphical 
representation of the time line. A portion of the time-based 
media may be selected for presentation by dragging or 
positioning at least one of the start graphical indicator and 
the stop graphical indicator along the graphical representa- 
tion of the time line. In another aspect of the invention, an 
exemplary method allows for the adaptive control of a 
portion of the interface which indicates time relating to a 
time-based media. An input speed is determined where this 
input is to change the portion and the rate at which the 
change to this portion occurs is dependent upon the input 
speed. Other aspects of the present invention relating to the 
interface for controlling the processing of time -based media 
files are also described. 
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USER INTERFACE FOR PRESENTING 
MEDIA INFORMATION 

FIELD OF THE INVENTION 

The present invention relates to user interfaces for pro- 
cessing (e.g., generating, storing, transmitting and/or 
receiving, playing back/displaying, editing, referencing, 
etc.) media information, such as time-based media data 
representing video and/or audio. In particular, the present 
invention provides an interactive digital processing system- 
controlled graphical user interface that provides functional- 
ity for play back or other processing of time-based and still 
media data. 

INTRODUCTION AND BACKGROUND 

There are a number of file structures used today to store 
time -based media: audio formats such as AIFF, video for- 
mats such as AVI, and streaming formats such as RealMedia. 
They are different at least in part because of their different 
focus and applicability. Some of these formats are suffi- 
ciently widely accepted, broad in their application, and 
relatively easy to implement, that they are used not only for 
content delivery but also as interchange formats such as the 
QuickTime™ file format. The QuickTime format is used 
today by many web sites serving time-based data; in many 
authoring environments, including professional ones; and on 
many multimedia CD ROM (e.g., DVD or CD-I) titles. 

The QuickTime media layer supports the relatively effi- 
cient display and management of general multimedia data, 
with an emphasis on time-based material (video, audio, 
video and audio, motion graphics/animation, etc.). The 
media layer uses the QuickTime file format as the storage 
and interchange format for media information. The archi- 
tectural capabilities of the layer are generally broader than 
the existing implementations, and the file format is capable 
of representing more information than is currently 
demanded by the existing QuickTime implementations. 
Furthermore, the QuickTime file format has structures to 
represent the temporal behavior of general time-based 
streams, a concept which covers the time -based emission of 
network packets, as well as the time-based local presentation 
of multimedia data. 

Given the capabilities and flexibility provided by time- 
based media formats, it is desirable to provide a user 
interface that provides suitable functionality and flexibility 
for playback and/or other processing of time-based media in 
such formats. 

Prior user interfaces for controlling the presentation of 
time-based media include user interfaces for the RealPlayers 
from RealNetworks of Seattle, Wash., user interfaces for the 
QuickTime MoviePlayers from Apple Computer, Inc. of 
Cupertino, Calif., and user interfaces for the Windows 
Media Players from Microsoft Corporation of Redmond, 
Wash. Also, there are a number of time-based, media author- 
ing systems which allow the media to be created and edited, 
such as Premiere from Adobe Systems of San Jose, Calif. 

These prior user interfaces typically use "pop-up" or 
pull-down menus to display controls (e.g. controls for con- 
trolling playback) or to display a list of "favorites" or 
"channels" which are typically predetermined, selected 
media (e.g. CNN or another broadcast source which-is 
remotely located or a locally stored media source). While 
these lists or menus may be an acceptable way of presenting 
this information, the lists or menus may not be easily 
alterable and the alteration operations are not intuitive. 
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Further, these lists or menus are separate from any window 
presenting the media and thus do not appear to be part of 
such window. 

In some prior user interfaces, the various controls are 
5 displayed on a border of the same window which presents 
the media. For example, a time bar may be displayed on a 
window with controls for playback on the same window. 
While these controls are readily visible and available to a 
user, a large number of controls on a window causes the 
30 window to appear complex and tends to intimidate a novice 
user. 

Some prior user interfaces include the ability to select, for 
presentation, certain chapters or sections of a media. Laser- 
Disc players typically include this capability which may be 

15 used when the media is segmented into chapters or sections. 
A user may be presented with a list of chapters or sections 
and may select a chapter or section from the list. When this 
list contains a large number of chapters or sections, the user 
may scroll through the list but the speed of scrolling is fixed 

20 at a single, predetermined rate. Thus, the user's ability to 
scroll through a list of chapters is limited in these prior user 
interfaces. 

Certain prior user interfaces which allow for editing of 
25 time-based media may include the ability of selecting a 
range of time of the media for editing in that selected range. 
However, these interfaces do not allow for the playback, 
through a single playback button, of a selected range of a 
media which has been selected by at least one dragging 
3Q action of an indicator. . 

SUMMARY OF TOE INVENTION 

The present invention relates to various aspects for con- 
trolling and/or presenting information concerning time- 

35 based media, such as a movie. 

In one aspect of the invention, an exemplary method of 
the invention allows for the selection of a presentation of 
time-based media. In this method, a graphical representation 
of a time line for the time-based media is displayed, and a 

40 graphical representation of a current time is also displayed 
along the graphical representation of the time line. A start 
graphical indicator and a stop graphical indicator is also 
displayed along the graphical representation of the time line. 
The start graphical indicator or the stop graphical indicator 

45 may be positioned, for example, by dragging, either of the 
indicator along the graphical representation of the time line 
to select a portion of the time-based media for presentation. 
In one typical example of this method, both the start 
graphical indicator and the stop graphical indicator may be 

50 dragged along the time line to select a portion of a movie for 
presentation. 

According to another aspect of the present invention, a 
method is provided for generating an interface for display 
for controlling the processing of time-based media data. A 

55 first set of data representing a graphical user interface as a 
primary window is generated and displayed. A second set of 
data representing a drawer window is generated and contains 
objects such as representations (e.g. icons) of "favorites" or 
"channels" media. In a first display state, the drawer window 

60 is at least partially overlapped by the primary window, and 
in a second display state is at least partially viewable. In one 
embodiment, the drawer window appears to be part of the 
primary window and slides under the primary window when 
the drawer window is closed. In one embodiment, when the 

65 primary window is moved, the drawer window moves with 
the primary window as part of the primary window. The 
drawer window, in one embodiment, provides a plurality of 



04/01/2004, EAST version: 1.4.1 



US 6,538,665 B2 

3 4 

locations which are fixed and predetermined, each for dis- FIG. 6 A is a diagram of time-based media player provid- 

playing a time-based media icon (e.g. a thumbnail image) ing an information panel (or drawer) window generated as 

associated with a time -based media file. In one embodiment, GUI, according to one embodiment of the invention, 

the thumbnail image represents a favorite or channel time- F IG. 6B is a diagram of a time-based media player 

based media, and the user may drag an icon into the drawer 5 providing a control panel (or drawer) window generated as 

window or out of the drawer window in order to alter the a GUI, according to one embodiment of the invention, 

contents of the drawer window. _ A .„ , . , . , , „ 

. ,. . _ FIG. 7 A illustrates a time/chapter display control of a 

According to another aspect of the present invention, a time-based media player generated as a GUI, and in 

method is provided for generating a graphical user interface particular, FIG. 7A illustrates an adaptive chapter display/ 

for control of processing of time-based media data. In an 10 control> accordi t0 one embodiment of the invention, 

exemplary method according to this aspect, a first set of data - n ♦„ t t 4 . ... , . 

representing the graphical user interface is generated and t - HG * ™ dluS rales , a «"neA:hapler display control of a 

displayed as a primary window. A second set of data f^ir £ F a y er S enerat ^ d as a GUI > and 1D , 

representing an auxiliary drawer window is generated for A' ™ ^ * d *f™^ d«play/ 

display. In a first display state, the auxiliary drawer window is COntro1 ' accordin S t0 one embod ™ent of the invention, 

is at least partially overlapped by the primary window and FIGS - 7C " 7J show the scrolling capabilities of the chapter 

in a second display state it is at least partially viewable. In display area 260 according to one embodiment of the 

one embodiment, the auxiliary drawer window appears to be invention. 

part of the primary window and slides under the primary FIG. 8 A illustrates a GUI mechanism of a time-based 
window when the auxiliary drawer is closed. When the 20 media player for selecting a range of time within a time- 
primary window is moved in one embodiment, the auxiliary based media file, according to one embodiment of the 
drawer window moves with the primary window as part of invention. 

the primary window. In one embodiment, the auxiliary FIG. 8B illustrates a GUI mechanism of a time-based 
drawer window provides information relating to a time- media player for selecting a range of time within a time- 
based media file or controls for the control of a time-based 25 based media file, according to one embodiment of the 
media file. invention. 

According to another aspect of the present invention, a FIG. 8C illustrates a flowchart which shows a method for 

method is provided for controlling a graphical user interface selecting a range of time for playback of a time-based media 

which processes time -based media information. In one file. 

exemplary method of this aspect, input to change a portion 30 FIGS gMF show an e le of a {imQCode mode 

of the graphical user interface is detected. Fhis portion selcctor interfacc which bc uscd witfa ^ currem ti 

indicates time relating to the time-based media. An input sM and end markefS 

speed of the input is determined and a rate at which to n 4 ... , 

change the portion is also determined, where the rate is J . F G * 9 ^ lllustrates an ada P tlve streaming status message 

dependent on the input speed. The information displayed in 35 display . of a time " based med *a P^yer generated as a GUI, 

the portion is changed according to the rate which is according to one embodiment of the invention, 

dependent upon the input speed. In one particular example ^IG. 9B illustrates an adaptive streaming status message 

according to this aspect of the invention, a chapter selection display of a time-based media player generated as a GUI, 

mechanism allows the user to select different chapters within according to one embodiment of the invention, 

a movie by causing a chapter display area to have chapters 40 FIGS. 9C-9H show another example of a status message 

scroll within the area. The speed of scrolling is controlled by display for a media player according to the present inven- 

the movement of a cursor or other input. tion. 

BRIEF DESCRIPTION OF THE DRAWINGS FIGS ' 1(M0C illu strate resizing a time-based media 

player generated as a GUI and/or a display window for 

FIG. 1 is a diagram of a network of computer systems in 45 displaying time-based images, according to one embodiment 

which media data may be processed, according to one of the invention. FIG. 10D is a flowchart which shows one 

embodiment of the present invention. method for controlling the display of a time-based media 

FIG. 2 is a block diagram of a digital processing system player during a resizing operation. FIGS. 10E and 10F show 

which may be used to process time-based media data, in examples of resizing operations. 

accordance with one embodiment of the present invention. 50 FIG. 11 is a flow diagram illustrating a method for 

FIG. 3 A shows a GUI and in particular, a time-based providing a favorite/channel drawer window for a time- 

media player display window for displaying, controlling, based media player generated as a GUI, according to one 

and/or otherwise processing time-based media data, accord- embodiment of the invention. 

ing to one embodiment of the invention. 55 FIG. 12A is a flow diagram illustrating a method for 

FIG. 3B shows an example of an audio-only window for providing adaptive chapter/time selection for play back or 

a time-based media player. other processing of time-based media in a GUI, according to 

FIG. 4 illustrate the time-based media player of FIG. 3A one embodiment of the invention. FIG. 12B shows an 

depicting a favorite/channel drawer that is partially open example of a chapter selection interface which adaptively 

(i.e., partially displayed), according to one embodiment of 60 scrolls a chapter indicator (e.g. a chapter number or name) 

the invention. in response to user input (e.g. speed of cursor movement). 

FIG. 5A is a diagram of a time-based media player FIG. 13 is a flow diagram illustrating a method for 

providing a favorite/channel drawer generated as a GUI, providing auxiliary drawers/panels for a time-based media 

according to one embodiment of the invention, player generated as a GUI, according to one embodiment of 

FIG. 5B shows an example of a user interface for altering 65 { hs invention, 

the icons in a drawer of a player window according to one FIG. 14 is a block diagram of a machine -readable medium 

embodiment of the invention. storing executable code and/or other data to provide one or 
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a combination of mechanisms for play back or other pro- 
cessing of time-based media in a GUI, according to one 
embodiment of the invention. 

DETAILED DESCRIPTION 

The present invention provides methods and apparatuses 
for processing media information. In one embodiment of the 
present invention, a graphical user interface (GUI) is pro- 
vided that includes a number of features for referencing, 
playing back, and/or otherwise processing time-based media 10 
information (e.g., video, animated graphics, and/or audio, 
etc.). In one embodiment, the GUI, also sometimes referred 
to as a media player, provides functionality for processing 
time-based media in the QuickTime format, such as Quick- 
Time "movies," which typically include audio and motion 35 
video information. Although the present invention is 
described with reference to the QuickTime media data 
format, it will be appreciated that the invention may also be 
used in a variety of environments, in conjunction with other 
media data formats, and with various types of data process- 20 
ing systems having a number of different types of architec- 
tures. Thus, the invention should not be limited to the 
systems, media data formats, or architectures disclosed 
herein, which are meant only to provide an understanding of 
the invention, whose scope is defined by the claims which 25 
follow. 

HARDWARE OVERVIEW 

FIG. 1 is a diagram of a network of computer systems in 
which media data may be processed, according to one 30 
embodiment of the present invention. As shown in FIG. 1, 
a network 100 includes a number of client computer systems 
that are coupled together through an Internet 122. It will be 
appreciated that the term "Internet" refers to a network of 
networks. Such networks may use a variety of protocols for 35 
exchange of information, such as TCP/IP, ATM, SNA, SDI, 
etc. The physical connections of the Internet and the proto- 
cols and communication procedures of the Internet are well 
known to those in the art. 

Access to the Internet 122 is typically provided by Inter- 40 
net service providers (ISPs), such as the ISP 124 and the ISP 
126. Users on client systems, such as the client computer . 
systems 102, 104, 118, and 120, generally obtain access to 
the Internet through Internet service providers, such as ISPs 
124 and 126. Access to the Internet may facilitate transfer of 45 
information (e.g., email, text files, media files, etc.) between 
two or more digital processing systems, such as the client 
computer systems 102, 104, 118, and 120 and/or a Web 
server system 128. For example, one or more of the client 
computer systems 102, 104, 118, and 120 and/or the Web 50 
server 128 may provide media data (e.g., video and audio, or 
video, or audio) to another one or more of the client 
computer systems 102, 104, 118, and 120 and/or the Web 
server 128. For example, in one embodiment of the 
invention, one or more of the client computer systems 102, 55 
104, 118 and 120 may request play-back of time-based 
media data that may be stored at a remote location, such as 
the Web server 128. In the case of remote storage, the data 
may be transferred as a file (e.g. downloaded) and then 
played back after transferring the file or, if a streaming 60 
media system is available, the data may be played back at the 
client while the transfer occurs. In another embodiment, the 
requested time-based media data may be stored locally at the 
client computer system 102, 104, 118, and/or 120. In the 
case of local storage, the client system may play back 65 
time-based media using a playback system (e.g. a Quick- 
Time Player) without requiring a network connection. 
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The Web server 128 typically includes at least one com- 
puter system to operate with one or more data communica- 
tion protocols, such as the protocols of the World Wide Web, 
and as such, is typically coupled to the Internet 122. 
Optionally, the Web server 128 may be part of an ISP which 
may provide access to the Internet and/or other network(s) 
for client computer systems. The client computer systems 
102, 104, 118, and 120 may each, with appropriate web 
browsing software, access data, such as HTML documents 
(e.g., Web pages), which may be provided by the Web server 
128. Such data may provide media, such as QuickTime 
movies, which may be played back/presented by the client 
computer systems 102, 104, 118, and 120, 

The ISP 124 provides Internet connectivity to the client 
computer system 102 via a modem interface 106, which may 
be considered as part of the client computer system 102. The 
client computer systems 102, 104, 118, and 620 may be a 
conventional data processing system, such as a Macintosh 
computer, a "network" computer, a handheld/portable 
computer, a Web TV system, or other types of digital 
processing systems (e.g., a cellular telephone having digital 
processing capabilities). 

Similarly, the ISP 126 provides Internet connectivity for 
the client computer systems 104, 118 and 120. However, as 
depicted in FIG. 1, such connectivity may vary between 
various client computer systems, such as the client computer 
systems 102, 104, 118, and 120. For example, as shown in 
FIG. 1, the client computer system 104 is coupled to the ISP 
126 through a modem interface 108, while the client com- 
puter systems 118 and 120 are part of a Local Area Network 
(LAN). The interfaces 106 and 108, shown as modems 106 
and 108, respectively, may represent an analog modem, an 
ISDN modem, a cable modem, a satellite transmission 
interface (e.g., "Direct PC"), a wireless interface, or other 
interface for coupling a digital processing system, such as a 
client computer system; to another digital processing sys- 
tem. The client computer systems 118 and 120 are coupled 
to a LAN bus 112 through network interfaces 114 and 116, 
respectively. The network interfaces 114 and 116 may be an 
Ethernet-type, Asynchronous Transfer Mode (ATM), or 
other type of network interface. The LAN bus is also 
coupled to a gateway digital processing system 10, which 
may provide firewall and other Internet-related services for 
a LAN. The gateway digital processing system 110, in turn, 
is coupled to the ISP 126 to provide Internet connectivity to 
the client computer systems 118 and 120. The gateway 
digital processing system 110 may, for example, include a 
conventional server computer system. Similarly, the Web 
server 128 may, for example, include a conventional server 
computer system. 

The system 100 may allow one or more of the client 
computer systems 102, 104, 118, and 120 and/or the Web 
server 628 to provide time-based media data (e.g., video and 
audio, or video, or audio) to another one or more of the client 
computer systems 102, 104, 118, and 120 and/or the Web 
server 128. As described below, the present invention facili- 
tates playing back and other functionality for processing the 
media data. 

FIG. 2 is a block diagram of a digital processing system 
which may be used to process time-based media data, in 
accordance with one embodiment of the present invention. 
For example, the digital processing system 150 shown in 
FIG. 2 may be used as a client computer system (e.g., the 
client computer system 102, 104, 118, and/or 120), a Web 
server system (e.g., the Web server system 128), a conven- 
tional server system, etc. Furthermore, the digital processing 
system ISO may be used to perform one or more functions 
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of an Internet service provider, such as the ISP 124 or 126. 166, which may include audio speakers, headphones, and/or 

The digital processing system 150 may be interfaced to other media playback output devices. In one embodiment, 

external systems through a modem or network interface 168. packetized media data may be transmitted across a data 

It will be appreciated that the modem or network interface communication network, such as a LAN and/or the Internet, 

168 may be considered as part of the digital processing 5 in accordance with the QuickTime format to be processed by 

system 150. The modem or network interface 168 may be an the system 150 in accordance with the present invention. On 

analog modem, an ISDN modem, a cable modem, a token tne olher hand> the digilal p roce ssing system 150 may 

ring interface a satellite transmission interface, a wireless locall store time _ based media dala in the mass m 

interface or o^ermterface(s) for providing a data commu- 162 ^ m m and/or another machine . readable 

nicanon link between two or more digUal processing sys- aQ medium accessible by the digilal processing system 150> as 

em ^* . . well as executable code that provides functionality for 

The digital processing system 150 includes a processor processing time-based media data in accordance with the 

152, which may represent one or more processors and may present invention 
include one or more conventional types of such processors, 

such as a Motorola PowerPC processor, an Intel Pentium (or 15 Overview of One Embodiment of the Invention 
x86) processor, etc. A memory 154 is coupled to the pro- 
cessor 152 by a bus 156. The memory 154 may be a dynamic FIG - 3A snows a GUI » and in particular, a time-based 
random access memory (DRAM) and/or may include static raedia P la y er display window for displaying, controlling, 
RAM (SRAM). The processor may also be coupled to other and/or otherwise processing time-based media data, accord- 
types of storage areas/memories (e.g., cache, Flash memory, 20 in g to one embodiment of the invention, 
disk, etc.), which could be considered as part of the memory As shown, a time-based media player (media player) 200, 
154 or separate from the memory 154. which is typically displayed as a window on a display of a 

The bus 156 further couples the processor 152 to a display computer or other digital processing system, includes a 

controller 158, a mass memory 162, the modem or network number of display and control functions for processing 

interface 168, and an input/output (I/O) controller 164. The 1S time-based media data, such as a QuickTime movie. The 

mass memory 162 may represent a magnetic, optical, player window 200 may be "closed" using a close box 222 

magneto-optical, tape, and/or other type of machine- (e.g. the user may "click" on this box to close the window 

readable medium/device for storing information. For by positioning a cursor on the box and depressing and 

example, the mass memory 162 may represent a hard disk, releasing a button, such as a mouse's button while the cursor 

a read-only or writeable optical CD (e.g., CD ROM, DVD), 30 remains positioned on the close box), 

etc. The display controller 158 controls in a conventional The media player 200 includes a movie display window 

manner a display 160, which may represent a cathode ray 202 for displaying a movie or other images associated with 

tube (CRT) display, a liquid crystal display (LCD), a plasma time-based media. In addition, a time/chapter display and 

display, or other type of display device. The I/O controller control region 204 of the media player 200 provides func- 

164 controls I/O device(s) 166, which may include one or 35 tionality for displaying and/or controlling time associated 

more keyboards, mouse/trackball or other pointing devices, with a particular time-based media file (e.g., a particular 

microphones (for speech recognition capabilities), magnetic movie processed by the player 200). As described below, a 

and/or optical disk drives, printers, scanners, digital time-based media file may be sub-indexed into "chapters" or 

cameras, microphones, etc. sections which correspond to time segments of the time- 

It will be appreciated that the digital processing system 40 based media file, and which chapters may also be titled. As 
150 represents only one example of a system, which may such, a user may view or select a time from which, or time 
have many different configurations and architectures, and segment in which, to play back a time-based media file. Such 
which may be employed with the present invention. For selection, as described below, may be based on a particular 
example, Macintosh and other systems often have multiple chapter name and/or a particular time relative to the time- 
busses, such as a peripheral bus, a dedicated cache bus, etc. 45 length of the time-based media file. 

On the other hand, a network computer, which may be used The media player 200 includes a number of other mecha- 
as a digital processing device of the present invention, may nisms for controlling playback, display, and/or other pro- 
not include, for example, a hard disk or other mass storage cessing of time-based media. For example, a volume dial 
device, but may receive routines and/or data from a network 220 controls the audio output level (e.g., through speakers, 
connection, such as the modem or interface 168, to be 50 headphones, or other audio output device). In one 
processed by the processor 152. Similarly, a Web TV embodiment, a cursor controlled through a pointing device 
system, which is known in the art, may be considered to be (e.g., a mouse, trackball, touchpad, arrow keys of a 
a digital processing system of the present invention, but such keyboard, etc.) or speech recognition enables a user to 
a system may not include one or more I/O devices, such as control the dial 220, as well as other features of the media 
those described above with reference to I/O device(s) 166. 55 player 200. For example, in one embodiment, a user may 
Additionally, a portable communication and data processing place the cursor upon the volume dial 200 using a pointing 
system, which may employ a cellular telephone and/or device, and control the audio output level/volume by hold- 
paging capabilities, may be considered a digital processing i ng down the "click" button of the pointing device (to select 
system which may be used with the present invention. 0 r "activate" the volume dial icon 220) and then moving the 
In the system 150 shown in FIG. 2, the mass memory 162 60 cursor up or down to change the level/volume up or down, 
(and/or the memory 154) may store time-based media (e.g., respectively. In one embodiment, a volume level display/ 
video, audio, movies, etc.) which may be processed accord- control 218 displays the current volume level by highlight- 
ing to the present invention. Alternatively, media data may ing on the display one or more graphical "level lines," 
be received by the digital processing system 150, for wherein when more lines are highlighted, the higher the 
example, via the modem or network interface 168, and 65 volume. r llius, as the dial 220 is "turned up" to increase the 
stored and/or presented by the digital processing system audio output level, more lines will become highlighted, and 
150, for example, via the display 160 and/or I/O device(s) conversely, when the dial 220 is "turned down" to decrease 
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the volume, less lines become highlighted in the volume described below, includes a number of other mechanisms to 
level display control 218. In the embodiment depicted in control play back and other processing of a time-based 
FIG. 3A, the user may also vary the audio output level/ media file, which mechanisms may include, for instance, 
volume by placing the cursor on the volume level/display audio balance, bass, and treble controls, forward/reverse 
control 218, activating the icon (e.g., by pressing and 5 scan controls, step back/forward controls, etc. As such, a 
holding a mouse or other pointing device selection/click user may activate the controls button 206 (e.g., by clicking/ 
button), and moving the cursor to the right (to increase the double clicking with a pointing device while the cursor is on 
volume) or to the left (to decrease the volume), in which case the controls button 206), and the control panel will, in one 
the dial 220 will turn up or down, respectively, while the embodiment, "slide" from the media player 200 window 
level lines of the volume level/display control 218 will be 10 appearing as if it was a drawer hidden/closed under the 
highlighted accordingly. Also, in one embodiment, the user media player 200. Similarly, a favorite/channel drawer con- 
may select (e.g. "click" on) the audio icon 217 to turn off the trol 214, when activated by the user (e.g., using a pointing 
audio portion of a presentation. As shown, the media player device), opens a favorite/channel drawer which is described 
200 also includes a play button 216 and a pause button 212, in further detail below. Finally, an information button 210 
which allow play back and pausing of a (currently selected) 15 opens an information tray 250 when activated and this tray 
time-based media file. will, in one embodiment, slide from the media player 200, 
As described below, the present invention provides sec- appearing as if it was a drawer hidden/closed under the 
ondary or "drawer" or "panel" or tray windows to be media player 200. 

"opened" from the primary or media player 200 window. As The size of the media player 200 and/or the motion video 

such, the drawer or panel or tray windows, when opened or 20 display window 202 may also be varied by activating a 

closed in response to user input, for example, will resemble resize control 208, In one embodiment, the media player 200 

drawers that open or close from the media player 200 is displayed at a default minimum size. In this embodiment, 

window, as shown in FIGS. 4, 5A,6A and 6B. These drawer when the resize control 208 is activated, two animated 

windows (e.g. the favorite/channel drawer window 230), in rectangles are. displayed: one animated rectangle represents 

one embodiment, arc part of the primary window and are 25 tne slz& °f tne motion display window 202 (with any image 

moved with the primary window and are opened or closed displayed therein) and the other animated rectangle repre- 

with the primary window. That is, when the primary window sents the media player 200 window. Each animated rectangle 

is moved around the desktop (on the display screen), the represents the currently selected size of one of these two 

drawer window is moved with the primary window and windows, and thus each animated rectangle indicates the 

appears attached to the primary window. When the primary 30 size of the window if the currently selected size is ultimately 

window is first opened, the handle portion of the drawer selected by the user. As such, the resize control 208 may be 

window is opened and is displayed and appears attached to "dragged" by the cursor to resize the motion video display 

the primary window. When the primary window is closed window 202 (and any image displayed thereby) without 

(e.g. removed from the display screen), the drawer window changing the size of the window 200 until the size of 

is closed. The drawer window, in one embodiment, typically 35 window 202 increases to a threshold size, which in one 

includes a handle portion which includes a drawer control embodiment, corresponds to substantially the edges of the 

(e.g. drawer control 214) which may be used to slide the media player 200 or a window 202 of dimensions 320x240 

drawer window open (e.g. display favorite/channel icons) or, pixels. When this occurs, an attempt to further enlarge the 

if the drawer window is opened, to close the drawer window motion video display window 202 will enlarge the media 

so that only the handle portion, typically attached to the 40 player 200 window and the window 202 together. In other 

primary window on an edge of the primary window, is words, if the outer window rectangle is larger than the 

displayed. The handle portion of the drawer window may minimum (default size), the two rectangles grow and shrink 

also include other controls, such as a resize control 208. In proportionally together. However, if the user attempts to 

one embodiment, objects, such as icons representing media shrink the media player 200 window's animated rectangle 

(e.g. "favorites" or "channels"), may be selected from 45 below the minimum size, only the motion video display 

regions outside of the drawer window (e.g. icons on the window 202 (and its animated rectangle) will shrink, and the 

desktop may be selected) and may be then dragged to a size of the media player 200 window will remain unchanged 

predetermined (e.g. "tiled") region inside of the drawer from the minimum size. 

window. This causes the selected object, in one exemplary FIG. 3B shows an example of an audio-only player 

embodiment, to become a "favorite" or "channel." Similarly, 50 window. The player window of FIG. 3B may include the 

an object (e.g. an icon representing a favorite or channel same controls and drawers as the player of FIG. 3A except 

media) may be selected within the drawer window and that only audio media is played back through the player 

dragged outside of the window (e.g. dragged to the desktop window of FIG. 3B. 

or to a folder on the desktop or dragged to an icon repre- H will be appreciated that the media presented through the 
senting a trash or waste receptacle or function). This has the 55 various interfaces of the invention is not limited to movies 
effect of either creating an alias or short cut for the selected with audio, or movies without audio, or audio-only time- 
object (when dragged to a folder) or deleting the object from based media (e.g. speeches or music), or still images or 
the drawer window. Thus, the drawer window, in one combinations of these media. It also will be appreciated that 
embodiment, acts as a desktop window into which, and from the drawers may contain any number of different types of 
which, objects (e.g. an icon of a favorite or a channel) may 6 0 controls or, generally, objects associated with media or 
be dragged and it appears as part of a primary window which control of the presentation of media. These controls in the 
presents media data (e.g. displays still images or movies or drawers allow a user to manipulate and design a presentation 
plays back audio only, etc.). 0 f mec jia 0 r otherwise control it. A drawer may contain a 
The drawers or trays of the media player 200 provide combination of controls (e.g. control buttons) and favorites 
additional functionality or information in association with 65 or channels of media, although in the embodiment shown in 
play back or other processing of a time-based media file. For FIGS. 4, 6A and 6B, the controls are displayed in one drawer 
example, the tray associated with a controls button 206, as separately from a drawer containing favorites and/or chan- 
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nels. It will also be appreciated that, in one instance, the a second (or displayed/open) state. This second state of the 

favorites are merely preselected media (either locally stored drawer window is shown in FIGS. 4 and 5 A. The drawer 

or received from a remote site) which the user (or the system may slide open with a sliding (e.g. nearly continuous) 

at the user's request or the system on its own) has decided animation or may "pop" open from a closed state. Similarly, 

to save for future use by designating the media as a favorite 5 tnc drawer may slide closed with a sliding animation or may 

(which is similar to the manner in which a web site is P°P closed without any sliding animation. The cursor can 

selected as a favorite or is selected as a bookmark in a Web further be controlled to place time-based media source icons 

browser such as Microsoft's Internet Explorer or Netscape's into the drawer (e.g. by dragging an icon from a desktop or 

Navigator). It will also be appreciated that a player window folder on the desktop to the drawer), remove time-based 

(e.g. window 200) may have multiple drawers for favorites 10 media source icons from the drawer, rearrange time-based 

or channels; for example, there may be two separate drawers media source icons between locations in the drawer or other 

for favorites and two separate drawers for channels. The windows, and/or select for playback a media file associated 

controls may also be placed in separate drawers. with an icon displayed in the drawer (e.g., by placing the 

cursor over that icon and activating the icon). As described 

Favorite/Channel Drawer 1$ beloWj me media player may also j nclude auxiliary drawer 

Now referring to FIG. 4, the time -based media player of windows which may be operated similarly to provide func- 

FIG. 3A is shown depicting a favorite/channel drawer that is tionality and/or information relating time-based media data 

partially open, according to one embodiment of the inven- that may be processed by the GUI media player of the 

lion. In particular, the media player 200 is shown along with present invention. 

a favorite/channel drawer 230. In one embodiment, in 20 In FIG. 4, the drawer 230 is shown partially opened to 
response to a user input with respect to the favorite/channel reveal a favorite/channel row 244 and a portion of a row 246. 
drawer control 214, which may involve activation of the The favorite/channel row 244 comprises favorite/channel 
favorite/channel drawer control 214 by placing a cursor wells 232, 234, 236, 238, and 240. Each favorite/channel 
thereon and clicking and holding a pointing device (e.g., a well represents, in one embodiment, a fixed, predetermined, 
mouse button), the favorite/channel drawer 230 may be 25 tiled display location within the drawer 230 that may contain 
"opened" as a secondary drawer window with respect to the a reference (e.g., a display/cursor activated icon) to particu- 
media player window 200, such that it appears to be at least lar time-based media source, which in one embodiment may 
partially overlapped by and attached to the media player be a particular time-based media file or a particular time- 
200. Prior to being opened as a secondary window, a handle based media channel. For example, as shown in FIG. 4, the 
of the secondary window is displayed next to the primary 30 well 234 contains a media source icon 248 and the well 238 
window, and this handle remains attached to the secondary contains a media source icon 250, each of which may 
window after the secondary window is opened. By moving reference a particular time-based media file or channel or 
the cursor up and down while the favorite/channel drawer may reference a non -time-based media file. Each row of the 
control 214 is activated (e.g. the cursor is placed over the drawer includes tiled compartments, each of which is 
control 214 and the mouse's button is held depressed), a user 35 designed to hold one media source icon. The filed compart- 
may close and open the favorite/channel drawer (window) ments have a fixed, predetermined location, thereby pre- 
230 to be displayed in various proportions relative to the venting placement (in one embodiment) of a media source 
media player 200 window. Examples of mechanisms and icon in an arbitrary location. Any attempt to drop an icon in 
terminology for display interfaces, cursor control, and an arbitrary location will result in the icon being placed into 
drawer user interfaces are described in U.S. Pat. No, 5,745, 40 an available well (not already occupied by an icon). That is, 
096, issued on Apr. 28, 1998, and entitled, "Desk Drawer the placement is restricted to the tiled (e.g. non-overlapping) 
User Interface," which is hereby incorporated by reference locations. In one embodiment, the media player 200 may be 
herein. The favorite/channel drawer 230 may also be generated and displayed on a client computer system, such 
referred to as a media drawer. as one shown in FIG. 1, and the media source icon 248 may 
Typically, the media player window 200 is displayed as a 45 reference a particular time-based media file, such as a 
primary window, for example, on a desktop window which QuickTime movie, that is stored locally by the client corn- 
may be moved around the desktop (e.g. moved by dragging puter system or at a remote location (e.g., a Web server 
the window around the desktop). The media player window system) that provides the media file for play back (or other 
may include a trigger region, such as the drawer control 214, forms of presentation) by the media player 200 in response 
for controlling display of a secondary window, the drawer 50 to a request. In one embodiment, such a play back request is 
230. It will be appreciated that while the drawer 230 is performed by activating the media source icon 248 (e.g., by 
referred to as a secondary window it is effectively, in one pointing the cursor thereon and clicking on it). For example, 
embodiment, part of the primary window in that it is if the time-based media file comprises motion video, such 
attached to the primary window and moves with the primary will be displayed in the display window 202 after activating 
window as it is moved around the desktop. A cursor control 55 the associated media source icon. In one embodiment when 
device (sometimes also referred to as a pointing device) may a source icon (e.g. icon 248) is activated, a highlighting is 
be used to control a cursor position on a display. displayed around the edges of the well which contains the 
Alternatively, speech recognition may be used to open and activated icon. 

close the favorite/channel drawer. When the cursor is placed In addition, a media source icon, such as the media source 

on a screen/display region of the trigger region and the 60 icon 248, may reference a particular media channel, such as 

region is selected (e.g., by depressing a mouse or other a news provider (e.g., CNN, Fox News, etc.), a major 

cursor select/activation input device) in a first state of the network (e.g., ABC, NBC, CBS, etc.), a shopping network, 

favorite/channel drawer window, in which state the contents or another channel. Such channels correspond to sources 

of the drawer window are not displayed (e.g., as shown in that typically provide continuous time-based media 

FIG. 3A), a user may drag the cursor (e.g., in a downward 65 information/programming via a media source, such as a Web 

direction) to "open" or reveal for display the contents of the server coupled to the Internet. Such a media source may 

drawer or a portion thereof, in which case the drawer is in stream media information into data packets that may trans- 
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ferred across a data processing network, such as the one 
shown in FIG. 1, according to the QuickTime or other media 
format and such data may not be stored locally (except 
perhaps for any ephemeral storage required for local 
playback). The address of such media is associated with the 5 
media source icon and is stored for quick access by the user. 

Thus, wells may be filled with icons associated with files 
from the user's digital processing system (e.g., a file may be 
dragged from the desktop or other window/directory to a 
well in the drawer or a file menu associated with the drawer 10 
may be used to add an icon to a well in the drawer) or may 
be filled with icons (which may sometimes also be referred 
to as "bookmarks") associated with streamed time-based 
media provided by a remote (e.g., Web) system. In one 
embodiment, a user may subscribe to certain channels, 15 
media (Web) servers, etc., which will then provide the icons 
associated with the subscribed media source(s) into wells in 
the drawer and/or any other directory associated therewith. 
Thus, in one embodiment, the drawer may be altered by the 
user or automatically altered/updated by a remote server or 2 o 
other digital processing system by transferring, rearranging, 
adding, or deleting time-based media icons therein. In one 
embodiment, the favorite/channel drawer may contain icons 
associated with "favorite" media of the user. 

In one embodiment, media source icons provide a graphi- 2 5 
cal reference to the media source associated therewith. For 
example, a particular frame of a motion video may be used 
as a "thumbnail" to represent the media source (e.g., file, 
channel, etc.) associated therewith. As such, data (e.g., a 
frame) from a particular media file or other media source 30 
may be used to generate a media source icon in the drawer 
230 to reference that particular media file. On the other hand, 
a media source icon may include text or symbols or other 
graphics or images to identify a media file or channel 
associated therewith. For instance, the logo/symbol associ- 35 
ated with a particular news or network channel may be used 
as a media source icon that references that channel to play 
back time -based media provided thereby when that icon is 
activated. 

In one embodiment, a particular time-based media icon 40 
may be highlighted graphically when selected (e.g., by 
placement of the cursor thereon and/or single clicking a 
pointing device thereon). Such highlighting, in one 
embodiment, includes providing a border around a selected 
time-based media icon. It will be appreciated that selection 45 
may, but does not always include, activation of the icon, the 
latter of which runs/loads the media (e.g. file or channel) 
associated with the icon. For example, in one embodiment, 
activating a particular time-based media icon is performed 
by selecting and then clicking that icon, which in turn causes 50 
the time-based media player 200 to play the time-based 
media file associated with that icon. In one embodiment, the 
drawer 230 may slide closed after a source icon in a channel 
has been selected for presentation (e.g. displaying video and 
reproducing the associated audio). 55 

FIG. 5A is a diagram of a time-based media player 
providing a favorite/channel drawer generated as a GUI, 
according to one embodiment of the invention. In particular, 
FIG. 5A shows the drawer 230 opened to a greater extent 
than shown in FIG. 4, for example, to reveal several well 60 
rows, including the well rows 244 and 246, the latter of 
which was partially hidden in the view of the media player 
200 shown in FIG. 4. In one embodiment, the amount of the 
drawer 230 which is visible is controlled by the user. In one 
embodiment of the invention, selected wells or well rows, 65 
such as the well rows 244 and/or 246, may be reserved for 
certain media sources, such as certain favorites or channels 



of media provided by a media server. On the other hand, 
other wells may be freely utilized to store media icons. In 
one embodiment, time-based media icons may be trans- 
ferred as icons and/or file names associated with time-based 
media sources from other locations/directories (e.g., a desk- 
top or other window) of a digital processing system to a well 
of the drawer; transferred from one well to another well 
within a drawer; and/or transferred from a drawer to another 
location/directory of the digital processing system. In one 
embodiment, known cursor dragging methods may be 
employed to facilitate such transfers. 

FIG. 5B shows an example of a graphical user interface 
according to the present invention which may be displayed 
on a display screen of a computer system. This interface 
includes a desktop 200b and a menu bar 200a having pull 
down menus, such as pull down menu 200/i. The desktop 
2006 includes an icon 200/ for a hard disk and an icon 200g 
for a folder as well as an icon for a media document 200d 
and an icon for a trash can 200c. A cursor 200e is also 
displayed on the desktop in the vicinity of the media player 
200. The media player 200 includes a close box 222 and a 
display window 202 for showing images. Below the window 
202 is the drawer 230 which has been opened to show four 
rows of wells, including rows 246 and 244. Four source 
media icons are shown in the drawer 230. A handle below 
the rows includes the drawer control 214 and the resize 
control 208. FIG. 5B will now be used to describe various 
processes for altering the contents of the drawer 230. A 
media source icon may be added to the drawer 230 by 
dragging the icon from the desktop or from a folder or from 
the hard disk icon into a well in the drawer 230. For 
example, the cursor 200e may be used to select and drag the 
icon 200d into the well 242 to thereby relocate the icon 200^ 
into the well 242 of the drawer 230. In this manner, if the 
icon 200^ represents a movie, this icon will be added to the 
drawer so the user may select for playback the movie 
represented by this icon by merely opening the drawer and 
then selecting this icon in well 242. This foregoing process 
may be reversed to thereby delete an icon from the well 230. 
For example, the cursor 200e may be used to select an icon, 
such as media source icon 248, and then to drag this icon 
from its well out of the drawer 230 and into the trash can 
200c. This will cause the icon 248 to be removed from the 
drawer 230 and this icon and its associated media will no 
longer be a favorite which can be selected by selecting an 
icon within the drawer 230. 

Another way to add a favorite into the drawer 230 is to 
open a media, such as a movie, so that it is displayed within 
the window 202 (or in the case of an audio file, the audio file 
is ready to be played). Then, the user can use the pull down 
menu 200/i to select the option "add favorite" which adds the 
media to the first available well in the drawer 230. 

The icons within the drawer 230 may also be used to 
create a short cut or alias to the media by dragging an icon 
from the drawer 230 to the desktop (except for the trash can). 

Auxiliary Drawers/Panels 

FIG. 6A is a diagram of time-based media player provid- 
ing an information panel (or drawer) window generated as 
GUI, according to one embodiment of the invention. In 
particular, FIG. 6A shows the bottom portion of the media 
player 200 shown in FIG. 3A having "opened" an informa- 
tion drawer 250. The information drawer 250 also represents 
a "drawer" or secondary window that may be revealed (or 
opened) or hidden relative to the media player 200 window. 
In one embodiment, the drawer 250 behaves relative to 
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window 200 in the same manner as drawer 230 behaves 
relative to window 200. For example, the 'drawer 250 
appears attached to and moves with the window 200 when 
the window 200 is moved around the desktop. The infor- 
mation drawer 250, in one embodiment, is primarily utilized 
to display any one or combination of various types of 
information associated with a currently selected media. Such 
information may include, but is not limited to, copyright/ 
trademark information, encryption information, data com- 
pression information, other credits, warnings, etc. For 10 respectively, of a time-based media file/channel. The adap 



be appreciated that chapters are typically descriptions (e.g. 
text) that indicate or correspond to a time or time range in 
a time-based media file. Also, a sequential list of chapters 
may represent the entire contiguous time of a time-based 
media file. 

In FIG. 7 A, the time/chapter display/control 204 of the 
media player 200 is shown, which includes an adaptive 
chapter display/control 260 and a time display 262, which 
display the corresponding chapter and current time, 



example, as shown in FIG. 6A, the information drawer 250 
displays the message "Compressed with Media Cleaner™." 

To view the information displayed by the information 
drawer 250 when the media player 200 window appears as 
shown in FIG. 3A (i.e., with the information drawer 250 15 
closed), the information button 210 may be selected (e.g., by 
placing the cursor over the button 210 and depressing and 
releasing a select button, such as a mouse button). In 
response to selection of the information button 210, the 
information drawer 250 will open (e.g. by appearing to slide 20 
out from under the window 200) and reveal information 
about the current media, for example, as shown in FIG. 6 A. 

FIG. 6B is a diagram of a time-based media player 
providing a control drawer window generated as a GUI, 
according to one embodiment of the invention. In particular, 
FIG. 6B shows the bottom portion of the media player 200 
shown in FIG. 3 having "opened" a control drawer 252. The 
control drawer 252 also represents a "drawer" or secondary 
window that may be revealed (or opened) or hidden relative 
to the media player 200 window. In one embodiment, the 
drawer 252 behaves relative to window 200 in the same 
manner as drawer 230 behaves relative to window 200. For 
example, the drawer 252 appears attached to and moves with 
the window 200 when the window 200 is moved around the 
desktop. In one embodiment of the invention, the control 
drawer 252 is provided to display additional controls/ 
functionality for play back or other processing of a time- 
based media by the media player 200. As shown in FIG. 6B 
and the control drawer 252, such information may include, 
but is not limited to, audio bass, treble, and balance controls, 
forward/backward scan, skip, etc. 

To utilize or view the controls/functions provided by the 
control drawer 252 when the media player 200 window 
appears as shown in FIG. 3A (i.e., with the control drawer 
252 closed), the control button 206 may be selected (e.g., by 
placing the cursor over the button 206 and depressing and 
releasing a select button, such as a mouse button). In 
response to selection of the control button 206, the control 
drawer 252 will open (e.g. by appearing to slide out from 
under the window 200) and reveal controls, such as those 
shown in FIG. 6Aand described above, to control play back 
and/or other processing of time-based media. 
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tive chapter display/control 260, as shown in FIG. 7A, is in 
an idle or unselected state, in which the current chapter 
(entitled "Swim excitedly") is truncated to a predetermined 
idle- state display size, as depicted by "Swim excit ..." 

On the other hand, when the adaptive chapter display/ 
control 260 is in an active state, as shown in FIG. 7B, its size 
adapts, in one embodiment, to display the entire title of the 
current chapter. In one embodiment, the adaptive chapter 
display/control 260 becomes active in response to a user 
input to change or browse/scroll through chapters. The user 
input may include, for example, clicking and holding a 
pointing device (e.g., mouse, trackball, etc.) button while the 
cursor is over the area 260. Alternatively, the user input may 
include speech commands which are recognized by a digital 
processing system. The user may then cause the chapter 
displayed by the adaptive chapter display/control 260 to 
change by moving the cursor (via a pointing device such as 
a mouse, for example) up and down to display the previous 
or next chapter(s), respectively. 

In one embodiment, the time it takes for the cursor to be 
moved up or down a specified distance above or below the 
midlevel or other predefined location of the adaptive chapter 
display/control 260 (e.g. the speed of the cursor movement) 
is used to determine the scrolling speed of the chapter(s) 
being displayed in the adaptive chapter/display control 260! 
As such, in one embodiment, the faster the cursor 
movement, the faster the chapters scroll up or down in the 
display 260, and conversely, the slower the cursor 
movement, the slower the chapters scroll in the area of the 
adaptive chapter/display control 260. 

In one embodiment, as a user scrolls up or down through 
chapters by moving the cursor over the adaptive chapter 
display/control 260, the times corresponding to the chapters 
arc also scrolled up or down in the time display 262. In one 
embodiment, the time may be directly changed up or down 
by placing the cursor on the time display 262, clicking and 
holding the pointing device select button, and moving the 
cursor up or down with the pointing device. In response, the 
50 chapter display 260 will also change to correspond to the 
time. Thus, the time display 262 and chapter display 260 are 
linked such that selecting a particular time will cause the 
chapter display 260 to show the corresponding chapter and 
visa versa. Furthermore, in one embodiment of the 
55 invention, the speed with which the cursor is moved up or 
down by the user (e.g., using a pointing device, such as a 
mouse) will determine the scroll speed of the indicators in 
time and/or chapter display areas 262 and 260. This will be 
further described below in conjunction with FIGS. 12 A and 
12B. 

FIG. 7C shows an example of the chapter display/control 
area 260 which includes the chapter designator 260a and an 
up arrow 2606 and a down arrow 260c. the cursor 260d is 
also shown in the vicinity of the control area 260 although 
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Time/Chapter Selection and Display 

FIGS. 7A-7B illustrate a time/chapter display control of 
a time-based media player generated as a GUI, and in 
particular, illustrate an adaptive chapter display/control, 
according to one embodiment of the invention. In one 
embodiment of the invention, a time-based media file may 
be indexed into chapters, wherein each chapter marks the 
beginning (and ending) of a particular time segment in the 
time-based media file. Such chapters may be predefined for 
a media file and/or may be determined by a user. Each 

chapter may be entitled by its index number (e.g., "Chapter 65 it is outside, in one embodiment, of the area 260. Typically, 
2" for the second chapter, and so forth) and/or have a the area 260 may be defined by the border 260e as shown in 
descriptive title (e.g., "Wedding scene"). Therefore, it will FIG. 7C. When the cursor 260d is within the border 260e, 
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then by starting a drag within this border, the scrolling of the 
chapters may be initiated as described herein. This will be 
further described in conjunction with FIGS. 7F-7J. 

FIG. 7D illustrates the appearance of the chapter area 260 
when the very first chapter or section is selected and 
displayed within the area 260. The chapter designator 260a 
indicates this is the first chapter and the up arrow 2606 is not 
highlighted while the down arrow 260c is highlighted. This 
difference in highlighting indicates that a user can only go 
down into the media rather than also being able to go up in 
the media. Note that with chapter 2 selected in FIG. 2C, the 
user can go in either direction. As shown in FIG. 7E, when 
the last chapter is indicated by the chapter designator 260a 
in the chapter area 260, only the up arrow 2606 is high- 
lighted while the down arrow 260c is not. 

FIGS. 7F, 7G, and 7H illustrate a scrolling up operation 
while FIGS. 71 and 7J illustrate a scrolling down process. 
The scroll begins in FIG. 7F by positioning the cursor 260d 
within the chapter area 260 and by moving the cursor in an 
upwardly direction as shown by the arrow 261a. Typically, 
the cursor is positioned within the area and then the user 
indicates the dragging of the cursor by pressing a mouse 
button or other button and holding the button down while 
moving the cursor. After the beginning of the drag, the up 
arrow 2606 becomes highlighted and the down arrow 260c 
is no longer highlighted, indicating the direction of the 
scroll, which in this case is up from chapter 4 to chapter 2 
as shown in FIG. 7H. FIG. 7G shows an intermediate stage 
where the cursor 260d has moved from approximately a 
midline point within the chapter display control area 260 to 
a point approximately two-thirds of the way up, resulting in 
chapter 3 being displayed as the chapter designator 260a 
while the up arrow continues to be highlighted during the 
scroll operation which ends in FIG, 7H as the cursor 260d 
is now positioned above the area 260. The scroll can 
continue as long as the mouse button or other button remains 
depressed, indicating an active drag of the cursor which 
began in the chapter display area 260. 

FIGS. 71 and 7J illustrate scrolling in the opposite direc- 
tion by positioning the cursor 260d within the area 260 and 
then dragging it down as shown by the arrow 2616. As the 
cursor 260<i is dragged downwardly, the chapter designator 
changes from chapter 3 to chapter 4 as shown in FIG. 7J, and 
the cursor 260^ is now closer to the lower portion of the area 
260 as shown in FIG. 7J. 

FIGS. 8A-^8B illustrate a GUI mechanism of a time-based 
media player for selecting for playback (or other 
presentations) a range of time within a time-based media 
file, according to one embodiment of the invention. As 
shown in FIGS. 8 A and 8B, in addition to the time display 
262 and the adaptive chapter display/control 260, the time/ 
chapter display/control 204 includes a time bar 271. The 
time bar 271 represents a time line of the current time-based 
media file. The position of a current time marker 274 on the 
time bar 271 indicates the current time (e.g., time currently 
being played back, such as an approximation of the time of 
the currently displayed frame in window 202) of the cur- 
rently selected media file. A user may drag the position of the 
current time marker 274 along the time bar 271 to change the 
time-based media file's current time to a currently selected 
time. In one embodiment, the time display 262 and the 
adaptive chapter display/control 260 are updated (to show 
the current time and current chapter, respectively) as the 
current time marker 274 is moved and a frame at the 
currently selected time is also displayed in window 202 to 
update that window. In one embodiment, when a lime-based 
media file is being played back, the current time marker 274 
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moves from the left to the right to indicate how much of the 
time-based media file (depicted by the entire length of the 
time bar 271) has elapsed or remains. 

In addition, a select start marker 270 and a select end 

5 marker 272 allow selection of a time jange within a time- 
based media file. This time range, once selected, allows 
playback (or other presentation) of only a portion of the 
time-based media file. In FIG. 8A, the select start marker 
270 is positioned at the left- most end of the time bar 271, 

10 which' coincides with time zero and the beginning of the 
current time-based media file. Also in FIG. 8A, the select 
end marker 272 is positioned at the right-most end of the 
time bar 271, which corresponds to the end of the time-based 
media file. Thus, if the time-based media file is played back 

35 with the markers positioned as shown in FIG. 8A, the entire 
time-based media file will be played back in window 202 
from beginning to end, unless stopped. 

On the other hand, as shown in FIG. 8B, the select start 
marker 270 is moved to the right relative to its position 

20 shown in FIG. 8A. Similarly, the select end marker 272 is 
shown moved to the left relative to its position shown in 
FIG. 8A. As such, only the time range corresponding to that 
portion of the time bar between the select start marker 270 
and the select end marker 272 shown in FIG. 8B is selected 

25 in FIG. 8B. Therefore, a user may select substantially any 
start or end time to determine a particular range of time for 
playback in a time-based media file. The selected range may 
be played back, used for editing (e.g., it may be cut from, 
added to, etc., to a time-based media file), used for creating 

30 a new time-based media file with the selected range and 
placing a corresponding icon in the favorite/channel drawer, 
or other purposes. 

In one embodiment, when a user changes or scrolls 
through the time or chapters of a time-based media file using 

35 any of the three mechanisms described with reference to the 
time/chapter display/control 204, the display window 202 of 
the media player 200 also displays the image frame at the 
corresponding time/chapter "dragged" by the user. 

FIG. 8C shows a flowchart which represents one particu- 

40 lar method for implementing the interface shown in FIGS 
8 A and 8B. In operation 275a a time bar, such as time bar 
271, is displayed with a current time indicator, such as the 
time display 262. In operation 2756, a start marker, such as 
the select start marker 270 is positioned on a location along 

45 the time bar 271. This may be achieved by positioning a 
cursor over the select start marker 270 and by dragging the 
select start marker 270 along the time bar 271. The operation 
of dragging an icon is well known in the art and may be 
achieved by positioning a cursor in association with the icon, 

50 selecting the icon by depressing a mouse button, and while 
keeping the mouse button depressed, moving the cursor and 
thereby also moving the icon in a drag operation. In opera- 
tion 275c, a number of different operations may occur 
concurrently with the drag operation in 2756 or at the end of 

55 a drag operation. In the preferred embodiment, these opera- 
tions may be performed during the drag operation rather 
than at the end. In this manner, feedback is given to the user 
as to the particular start frame which has been selected as the 
start select marker 270 is moved along the time bar 271. 

60 Some or all of the operations in operation 275c may be 
performed as these drag operations occur. The time display, 
such as time display 262, may be updated (e.g. updated from 
00:00:00 to 00:05:05) as the start marker is dragged along 
the time bar. The time display will be updated to indicate the 

65 start lime selected at the current location of the start marker 
270 along the time bar 271. Also, the display frame which 
has been selected as the start frame may be displayed within 
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the window 202. Further, the time bar itself may be updated 
to indicate the selected portion of the time-based media. This 
is shown in FIGS. 8 A and 8B by the highlighting which 
occurs in the middle of the time bar 271 while the ends of 
the time bar are not highlighted. Dragging the start selector 5 
270 from left to right will change the amount of highlighting 
along the time bar, thereby indicating the amount of the 
movie which has been selected for playback. Also, the 
current time marker may optionally be moved to coincide 
with the start time marker. Further, the chapter display may 10 
be updated to show the chapter corresponding to the time 
selected by the start marker's position along the time bar. Of 
course, if a particular time-based media file has no chapters, 
there is no need to update the chapter display in the control 
area 260. 35 

The user may perform a positioning operation on the 
select end marker 272 as indicated in operation 27 Sd of FIG. 
8C. In particular, the user may drag the end marker to a 
location along the time bar 271 or may position the cursor 
without a drag operation over a particular location and then 2 o 
click to indicate that location after having previously 
selected the end marker for a positioning operation. The 
same type of positioning operation may be performed with 
the start marker 270. As the end marker is dragged along the 
time bar 271, the time display 262 indicating the end of the 2 s 
movie may be updated and a display area 202 may also show 
the currently selected end frame in order to let the user know 
when the selected portion of the movie will end. Also, the 
time bar may be highlighted or shaded to indicate the end of 
the selected portion as shown in FIG. 8B and this highlight- 30 
ing or shading may be updated as the select end marker is 
dragged along the time bar 271, Further, the chapter display 
may be updated during the drag operation or positioning 
operation of the end marker to show the chapter correspond- 
ing to the time selected by the end marker's position along 35 
the time bar. 

After positioning one or both of the start and/or end 
markers, the user may cause the presentation of the selected 
range/portion of the time-based media by, for example, 
"clicking" on the play button 216. 4 o 

FIGS. 8D, 8E, and 8F illustrate the display, in one 
embodiment, of a time display/control area 204. This area 
204 includes a time bar 271 as well as a current time marker 
274 and select start marker 270 and select end marker 272. 
The display and control area 204 also includes time display 45 
262. As with the embodiment shown in FIGS. 8A and 8B, 
the current time marker shows the current time for the 
current frame relative to the time bar 271. The select start 
marker 270 shows the selected start time and the select end 
marker 272 shows the selected end time. The markers 270, 50 
272, and 274 may be dragged along the time bar 271 as with 
the embodiment shown in FIGS. 8 A and 8B in order to 
modify the current time or the start time or the end time as 
described above. Three buttons on the left portion of the 
control and display area 204 relate and correspond to the 55 
three markers 270, 272, and 274. In particular, the button 
276a corresponds to the select start marker 270, and the 
marker 276b corresponds to the current time marker 274, 
and the select end marker 272 corresponds to the button 
276c. Each of these three buttons 276a, 276b, and 276c may 60 
be selected (e.g. by positioning a cursor over the button and 
depressing and releasing a mouse button or another key on 
the system), and when the particular button is depressed, the 
time of the corresponding marker is shown in the display 
time area 262 and the corresponding marker is also high- 65 
lighted with its corresponding button. For example, as 
shown in FIG. 8D, the selection of the button 276a causes 
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the start marker 270 to be highlighted and causes the time 
display 262 to show the time of the select start marker 270. 
Similarly, FIG. 8E shows that when the button 276b is 
selected, it becomes highlighted and the current time marker 
274 becomes highlighted and the time of the current time 
marker is displayed within the time display 262. Similarly, 
FIG. 8F shows that when the button 276c is selected, it 
becomes highlighted and the select end marker 272 becomes 
highlighted and the ending time selected by the marker 272 
is shown in the time display 262, 

These buttons 276a, 276b, and 276c also provide feed- 
back to a user, indicating which of the three markers is being 
selected and manipulated by the user. For example, when the 
select start marker 270 is selected and is being dragged along 
the time bar 271, the button 276a becomes highlighted while 
the buttons 276b and 276c are not highlighted. This indicates 
to the user that the start marker is being manipulated and the 
time display 262 is updated to follow the movement of the 
marker 270 to show the currently selected start time. 
Similarly, when the current time marker 274 is selected for 
direct manipulation (e.g. a dragging of the marker 274) then 
the button 276b is highlighted while the other buttons 276a 
and 276c are not highlighted. Similarly, when the marker 
272 is being dragged along the time bar 271, the button 276c 
is highlighted while buttons 276a and 276b are not high- 
lighted as shown in FIG. 8F. 

Streaming Status Message Display 

FIGS. 9A-9B illustrate an adaptive streaming status mes- 
sage display of a time-based media player generated as a 
GUI, according to one embodiment of the invention. This 
status message display may also be used for non-streaming 
media. 

In one embodiment, the media player 200 may play back 
or otherwise process time-based media received over a 
network. For example, a QuickTime movie may be streamed 
by a remote digital processing system, typically a server, to 
the user's local system, where the user has requested the 
movie (e.g., by clicking on an icon in the favorite/channel 
drawer of the media player being executed on the local 
system, wherein the icon references the movie and/or the 
server that provides the movie). 

As shown in FIGS. 9A and 9B, the time/chapter display/ 
control 204 provides a mechanism for displaying status 
information related to streaming of time-based media over a 
network. In particular, as shown in FIGS. 9A and 9B, an 
adaptive streaming message display 280 appears in the 
time/chapter display/control 204, The adaptive steaming 
message display 280 scrolls in from the right-most portion 
of the time/chapter, display/control 204 to display status 
messages such as "Connecting . . . ", "Negotiating . . . 
"Receiving . . . "Buffering , . . and/or other status 
messages. The status messages in the message display 280 
scroll from the right and cover as much of the time/chapter 
display/control 204 as needed to display the message. 

In one embodiment, when a currently displayed status 
message is to change to the next status message (e.g., from 
"Connecting" to "Negotiating"), the current message will 
scroll "out" to the right. For example, FIG. 9A shows a 
portion of the message "received PLAY response ..." 
scrolling in from the right to the left in the adaptive 
streaming message display 280, while FIG. 9B shows a 
larger portion of the same message having been scrolled in 
from the right to the left. However, if another status message 
were to follow, the message "received PLAY response ..." 
would scroll out from the left the right (i.e., in the opposite 
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direction). Thus, in one embodiment of the invention, each 
status message appears and disappears in a streaming/ 
scrolling fashion. 

FIGS. 9C-9H illustrate an alternative embodiment for a * 
status message display for a media player according to one 5 
embodiment of the invention. Each of these figures shows a 
portion of the display control area 204. This portion shown 
may be the middle of the area, for example, the middle of the 
area shown in FIG. 7A. In this instance, the time bar may not 
be displayed while these messages scroll through this area. 30 
FIG. 9C shows the beginning of a sequence of messages 
which may occur when the media player is receiving a 
streaming media. It will be appreciated that this embodiment 
of the present invention may be utilized with live or stored 
streaming and may be used with non-streaming media; the 35 
content of the messages would, of course, be tailored to 
provide the appropriate information depending on the type 
of media and the type of connection and whether it is 
streaming or non-streaming media. As shown in FIG. 9C, the 
first message is "Connecting" and this message begins to 20 
scroll down in the area shown in FIG. 9C and the next 
message scrolls in from the top as the previous message 
"Connecting" is scrolling down. FIG. 9D shows a particular 
stage in which the first message "Connecting" has scrolled 
down to near the bottom while the second message "Nego- 25 
dating" has scrolled into the area and is scrolling down. FIG. 
9E shows the second message "Negotiating" has scrolled 
further down and the first message "Connecting" has 
scrolled out of view. This scrolling in a vertical direction 
from top to bottom continues as the third message "Buffer- 30 
ing" scrolls into view as shown in FIG. 9F. The next message 
may be either that shown in FIG. 9H ("Live Broadcast" in 
the case of a streaming live media) or the time bar 271 with 
its associated markers as shown in FIG. 9G in the case of a 
stored streaming media or other media. 35 

Thus the interface provided by the embodiment shown in 
FIGS. 9C-9H provides a vertical scrolling of messages 
through the area 204 by removing the lime bar for a portion 
of the time. 

40 

Media Player and Display Window Resizing 

FIGS. 10A-10C illustrate resizing a time -based media 
player generated as a GUI and/or a display window for 
displaying time-based images, according to one embodiment 45 
of the invention. In one embodiment, the size of the media 
player 200 again depicted in FIGS. 10A-10C and/or the 
motion video display window 202 may be varied by drag- 
ging the resize control 208 (e.g., by depressing and holding 
a mouse button or other pointing select button on the resize 50 
control 208, and then moving the cursor using the mouse). 

In one embodiment, the media player 200 is displayed at 
a default minimum window size, which is shown in FIGS. 
10A and 10B while the window 202 within the player 200 
may have different sizes as shown in FIGS. 10A and 10B. 55 
The video display window 202 may also have a minimum 
size, which in one embodiment is equal to 320x240. It will 
be appreciated that alternative embodiments may incorpo- 
rate various other minimum or default sizes or may not 
incorporate a minimum size. 60 

In one embodiment, when the resize control 208 is 
dragged, two animated rectangles are displayed: one ani- 
mated rectangle represents the size of the display window 
202 (any image displayed therein) and the other animated 
rectangle represents the size of the media player 200 win- 65 
dow (which contains the window 202). The resize control 
208 may be "dragged" by the cursor to resize the motion 
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video display window 202 (and any image displayed 
thereby) without resizing the window 200 until the size of 
window 202 increases to a threshold size, which in one 
embodiment, corresponds to substantially the edges of the 
media player 200, which is shown in FIG. 10B. When this 
occurs, an attempt to further enlarge the motion video 
display window 202 will enlarge the media player 200 
window as well, which is shown in FIG. 10C. However, if 
the user attempts to shrink the media player 200 window 
below the default minimum size, only the display window 
202 (and its animated rectangle) will shrink, and the size of 
the media player 200 window will remain unchanged from 
the minimum size. 

FIG. 10D is a flowchart which illustrates one method of 
performing a resizing operation with the two windows 
included in media player 200. FIGS. 10E and 10F illustrate 
examples of these two windows during a shrinking operation 
(FIG. 10E) or an enlarging operation (FIG. 10F). 

Operation 290a of FIG. 10D detects a user input to change 
the size of a window in the time-based media player 200. 
Typically, this will involve a user positioning the cursor over 
the resize control 208 and while selecting that control, 
moving the cursor while the control remains selected. As 
long as the control is selected (e.g. keeping the mouse's 
button depressed down) the user is indicating to the system 
that the window is to be resized. The system will monitor the 
user's position of the cursor and control the size of the 
window in a corresponding manner. Typically, two animated 
windows are displayed, one corresponding to the currently 
selected size of the inner window and the other correspond- 
ing to the currently selected size of the outer window. The 
animated windows are animated because they change in size 
as the resizing operation occurs. In. the case of the preferred 
embodiment, the outer window does not change size unless 
it is currently selected at a size larger than the predetermined 
size. This is shown in FIG. 10E in which the rectangle 2916 
represents the predetermined size of the outer window, 
which in this case is the outer perimeter of the player 200 
shown in FIG. 3 A. The rectangle 291e represents the inner 
window's periphery at the end of a drag of the cursor 291a 
while the rectangle 291d represents the inner window's 
periphery at the start of the drag. The arrow 291h represents 
the direction of the drag starting from one location and 
inwardly towards the rectangle 291e. The rectangle 291c is 
shown within the rectangle 2916 only for purposes of 
illustration to separately show the two rectangles. It will be 
appreciated that the rectangle 291c represents the outer 
window's periphery and that this periphery does not shrink 
below the predetermined size represented by the rectangle 
2916. The animated rectangles 291/ and 291g appear during 
the process of dragging from the beginning position of the 
cursor to the ending position of the cursor as the inner 
window is reduced in size. It will be appreciated that there 
are a number of ways to animate the changing size of a 
window. In one embodiment, a zooming series of shrinking 
rectangles may be displayed as the user moves the cursor 
from one location near the outer window's periphery 
towards the inner window's periphery. These zooming ani- 
mated rectangles are well known in the art. 

FIG. 10F represents an expansion of both the inner and 
outer windows as the user drags the cursor 291a along the 
path 291i. In this case, the outer window is dragged beyond 
the predetermined size shown by rectangle 2916 to its final 
size shown by rectangle 291L. Similarly, the drag operation 
enlarges the inner window from its beginning size shown by 
rectangle 291m to its final size shown by rectangle 291/?. 
During the dragging operation, several animated rectangles 
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may be displayed for both the inner and outer windows 
showing the user the size of both windows. This feedback 
allows the user to be able to determine the size of the outer 
window and also to determine the size of the inner window 
while a dragging operation is occurring. Thus, for example, 5 
the user can enlarge the inner window to see a bigger picture 
while at the same time assuring that the outer window is not 
enlarged too much such that it may, obscure background 
features on a desktop or that it may extend beyond display- 
able area such that controls on the outer window may not be 10 
available. 

Referring back to FIG. 10D, the operation, once user input 
is detected, proceeds to operation 290Z? in which the size of 
the outer window being changed is compared to a predeter-. 
mined size such as a predetermined area. If this outer 15 
window is being changed below a predetermined size, then 
processing proceeds to operation 290g. This is shown in 
FIG. 10E in which there is a changing outline of the inner 
window which is animated to indicate the changing size of 
the inner window but the dragging operation does not affect 20 
the size of the outer window as long as the size of the outer 
window's size remains below the predetermined size. In 
operation 290h, it is determined while dragging whether the 
size of the outer window is less than the predetermined size. 
If it is not, processing proceeds to step 290/ in which it is 25 
determined whether dragging has been completed. If, in 
operation 290, it has been determined that the size of the 
outer window is larger than the predetermined size, then 
processing proceeds to operation 290c. If, in operation 290/, 
it has been determined that dragging has ended, then pro- 30 
cessing returns back to operation 290b, otherwise, if drag- 
ging has ended in operation 290/, the size of the inner 
window is changed to the final selected size of the inner 
window. Typically, this will mean that the periphery of the 
inner window will be the same size as the periphery of the 35 
animated window which was displayed when the drag was 
ended. 

Operation 290c is illustrated in FIG. 10F in which both 
the inner and outer windows have animated zooming rect- 
angles associated with the windows while the user drags the 40 
resizing control. Animated rectangles 291« and 291o are 
examples of zooming animated rectangles for the inner 
window, and animated zooming rectangles 291; and 291k 
are examples of animated windows for the outer window. In 
operation 2904 it is determined whether the size of the outer 45 
window is less than the predetermined size. If it is not, 
processing proceeds to step 290e. If, in fact, the size of the 
outer window is . less than the predetermined size, then 
processing proceeds to operation 290g. In operation 290e, if 
the drag has ended, then processing proceeds to operation 50 
290/ in which the inner and outer windows are set to the new 
selected sizes. If the drag has not ended as determined in 
operation 290e, then processing returns back to operation 
290c. 

In this manner, the size of both the inner and outer 55 
window may be determined by looking at the current size of 
the animating rectangles. 

In alternative embodiments, two separate resize mecha- 
nisms may be provided, each to control resizing of one of the 
media player 200 and the display window 202. 60 

Method for Providing a Favorite/Channel Drawer 
Window 

FIG. 11 is a flow diagram illustrating a method for 
providing a favorite/channel drawer window for a time- 65 
based media player generated as a GUI, according to one 
embodiment of the invention. Flow begins at block 302. 
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At block 304, input is detected to open a favorite/channel 
drawer window relative to a media player window. For 
example, such input may include dragging a drawer control 
icon, such as the favorite/channel drawer control 214 of FIG. 
3A, in the same direction in which the favorite/channel 
drawer is to be opened, and doing so until a desired portion 
of the favorite/channel drawer is displayed. As such, in one 
embodiment, the size of the drawer window (and how many 
wells are displayed) is incrementally selectable to the extent 
that a user drags open or closed the favorite/channel drawer. 
On the other hand, in an alternative embodiment, the drawer 
window may be opened (e.g. displayed) at only a predeter- 
mined size, such that a user may open the drawer to such size 
by selecting an icon (e.g. "clicking" or double -clicking on 
the icon by positioning a cursor on the icon and depressing 
a button or by speaking the icon's name in a system with 
speech recognition capabilities) and may close the drawer 
window by "clicking" or double-clicking on the same icon. 
Alternatively, keyboard commands (e.g. "command]") may 
be used to open and close the drawer window or the 
selection of a command from a pull down menu may open 
or close the drawer window. 

At block 306, the drawer window is displayed. As men- 
tioned above, the extent to which the drawer window is 
displayed may be selectable, for example, as determined by 
the extent the drawer window is "dragged open" by a user, 
or may be displayed at a default/non-selectable size or 
proportion. 

At block 308, if input is detected to select an icon in the 
drawer or to alter the drawer (e.g., to add, delete, rearrange, 
etc., an icon), flow passes to block 314. Otherwise, flow 
passes to block 310. The input may include clicking on an 
icon in a well of the drawer, dragging an icon to or from a 
well, etc. 

At block 310, if input is detected to close the drawer (e.g., 
a user dragging the drawer control 214 up to hide to the 
drawer or a portion thereof), flow passes to block 312 where 
the drawer window is (at least partially) closed. Otherwise 
flow passes back to block 306. 

At block 314, if the input detected at block 308 is directed 
to playback of time-based media data (e.g., the user clicks an 
icon in the drawer), flow passes to block 316, where the 
time-based media file is played back by the time-based 
media player. For example, the user may click on a time- 
based media icon in the drawer that references a time-based 
media file, such as a QuickTime movie, that is stored locally 
or at a remote server. The movie would then be retrieved and 
played back from local storage or streamed to the user's 
local system where the media player would display the 
movie (e.g., in the display window 202) and/or playback 
audio tracks of the movie. 

Otherwise, flow passes to block 318, where the drawer 
window is altered. Such alteration may include dragging an 
icon or file name from another location in the user's com- 
puter system (e.g., the desktop or other directory/location) to 
a well of the drawer or visa versa; dragging a time-based 
media icon from one well location to another well location; 
deleting a time-based media icon from the drawer; etc. 

Adaptive Chapter/Time Selection 

FIG. 12 A is a flow diagram illustrating a method for 
providing adaptive chapter/time selection for play back or 
other processing of time-based media in a GUI, according to 
one embodiment of the invention. Flow begins at block 330. 

At block 332, a time-based media player window, such as 
the media player 200 window shown in FIG. 3A, is dis- 
played. 
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At block 334, media time and/or chapter control and/or 
display mechanisms are displayed. For example, in one 
embodiment, such mechanisms may include a time display 
(e.g., the time display 262 shown in FIGS. 8A and 8B), a 
time bar with selection markers and/or a current time 5 
indicator (such as shown in FIGS. 8A and 8B), and/or a 
chapter display/control (e.g., the adaptive chapter display/ 
control 260 shown in FIGS. 8A and 8B). 

At block 336, input is detected to alter a time or chapter 
(which two are typically, but not necessarily linked). For 30 
example, such input may include a user placing the cursor in 
the chapter display/control or the time display and then 
dragging the cursor up or down to scroll up or down through 
chapters (or time). 

At block 338, based on a characteristic of the input, the 35 
time and/or chapter is adaptively changed. In one 
embodiment, the characteristic includes the speed in which 
a cursor is dragged over the chapter display/control (or time 
display). Based on measuring the time in which the cursor 
covers a specified distance, the cursor dragging speed is 20 
determined. Once the drag speed is determined, the speed in 
which the displayed chapters in the chapter display/control 
are scrolled is varied in direct proportion to the cursor drag 
speed. As such, a user can control the speed he/she wishes 
to scroll through and view chapters or time by using various 25 
cursor dragging speeds to obtain directly proportional scroll- 
ing speeds. 

FIG. 12B shows a representation of a graphical user 
interface which may be used with a method shown in FIG. 3Q 
12 A. The interface shown in FIG. 12B is similar to the 
adaptive chapter portion of the interface shown in FIGS. 7A 
and 7B. It will be appreciated that the chapter display area 
339a of FIG. 12B may display the names of the chapters 
(e.g. swim excitedly) rather than the designator "chapter" 35 
with a numeral as shown in FIG. 12B. The designator 
chapter 3396 may alternatively say sections or other desig- 
nators to indicate portions of the time-based media. A 
numeral region 339rf may display a numeral indicating the 
chapter number and this area 33 9d may provide for scrolling 4Q 
of numerals within the area in response to selecting the 
chapter region 339a. This selection may be performed by 
positioning the cursor 339c in the chapter area and then 
dragging the cursor in an up or down direction. The arrows 
339e and 339/ represent different velocities of the drag 45 
which will in turn cause different scrolling speeds within the 
numeral area 339 d. In this manner, the user may control the 
scrolling speed of the chapter designators (e.g. chapter 
numerals or titles) by controlling the speed of the cursor 
during a drag of the cursor over the chapter area 339a. 5Q 

Auxiliary Drawer/Tray Windows 

FIG. 13 is a flow diagram illustrating a method for 
providing auxiliary drawers/trays for a time-based media 
player generated as a GUI, according to one embodiment of 55 
the invention. Flow begins at block 340. 

At block 342, a time-based media player window, such as 
the media player 200 window shown in FIG. 3 A, is dis- 
played. 

At block 344, input is detected to open one or more 60 
auxiliary drawer windows, such as the information drawer 
250 or control drawer 252, described above with reference 
to FIGS. 6A-6B. The input may include the selection of a 
button displayed on the window (e.g. clicking of a pointing 
device select button (e.g., a mouse button) with the cursor 65 
over an icon that controls the auxiliary drawer window to be 
opened). 
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At block 346, the auxiliary drawer window is "opened" 
for display. In one embodiment, the auxiliary drawer is of a 
predetermined size. In alternative embodiments, one or more 
auxiliary drawers may be selectively displayed at various 
sizes (e.g., under user control), for example, as depicted by 
the drawer window shown in FIGS. 4-5A, The auxiliary 
drawer may provide information about time-based media 
and/or provide mechanisms for play back or other process- 
ing of time-based media. Such mechanisms may include 
display and/or control of bass, treble, balance; a graphic 
equalizer; forward/backward rewind, scan, skip, etc., or 
other controls for play back or processing of time-based 
media information such as audio, video, or a combination 
thereof. Once the auxiliary drawer is displayed, various 
controls may be modified or selected by the user. 

Software Overview 

FIG. 14 is a block diagram of a machine-readable medium 
storing executable code and/or other data to provide one or 
a combination of mechanisms for play back or other pro- 
cessing of time-based media in a GUI, according to one 
embodiment of the invention. The machine-readable storage 
medium 350 represents one or a combination of various 
types of media/devices for storing machine-readable data, 
which may include machine-executable code or routines. As 
such, the machine-readable storage medium 350 could 
include, but is not limited to one or a combination of a 
magnetic storage space (e.g., a hard or floppy disk), 
magneto-optical storage, tape, optical storage (e.g., CD 
ROM, DVD, etc.), dynamic random access memory 
(DRAM), static RAM (SRAM), flash memory, etc. 

The medium 350 is shown storing a time-based media 
player routine 352 which, when executed, provides a time- 
based media player as a GUI such as the player 200. The 
time-based media player routine 352 includes a number of 
mechanisms for playing back or otherwise processing time- 
based media processed by the time-based media player. For 
example, a drawer routine 354 generates a drawer window, 
such as drawer 230, for display. The drawer may contain 
wells for displaying one or more references (icons) to media, 
such as files/channels, which may be stored locally by a 
digital processing coupled to the medium 350, or by a 
remote system, such as a time-based media Web server. The 
drawer routine 354 may also facilitate altering of the drawer 
to add, delete, rearrange, select for play back, etc., icons 
displayed therein. An adaptive time/chapter selection routine 
356 allows adaptively varying the display of time or chapter 
information (e.g., the speed at which such information is 
displayed as being scrolled, as described in conjunction with 
FIGS. 12A and 12B) in response to detection of an input 
characteristic (e.g., cursor drag speed when user input causes 
such information to be varied). A time bar selection marker 
routine 358 provides a time bar for display, as well as select 
start/end and current lime marker functionality, as described, 
for example, with reference to FIGS. 8A-8C or 8D-8F. A 
streaming status message routine 360 provide streaming of 
status messages, for example, as described above with 
reference to FIGS. 9A-9B or 9C-9H. A player/display 
window resizing routine allows resizing of a time-based 
media player window and/or a motion video display window 
according to one or more of the methods described above, 
for example, with reference to FIGS. 10A-10F. Finally, an 
auxiliary drawer routine provides display areas in the form 
of drawers in addition to or in lieu of the favorite/channel 
drawer, which auxiliary drawers may provide information or 
additional mechanisms for display and play back or other 
processing of media. 
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The machine readable storage medium may also store an 
operating system (OS) 366, which may provide a graphical 
window/icon oriented environment; a data communication 
routine 370 that facilitates transfer of media and/of other 
information over a digital processing network; and/or stored/ 
buffered time-based media 368. 

It will be appreciated that alternative embodiments of the 
GUI for processing time-based information may include 
fewer or more of the functions described herein. 
Furthermore, the invention may be implemented in any 
combination of hardware and/or software. 

Alternative Embodiments 

While the invention has been described in terms of several 
embodiments and illustrative figures, those skilled in the art 
will recognize that the invention is not limited to the 
embodiments or figures described. In particular, the inven- 
tion can be practiced in several alternative embodiments that 
provide one or a combination of mechanisms for playing 
back or otherwise processing time-based media information 
(e.g., QuickTime movies) in a graphical user interface. 
Furthermore, the icons in a drawer may represent media 
other than time-based media, such as still images or inter- 
active content or Web page links, etc. 

Therefore, it should be understood that the method and 
apparatus of the invention can be practiced with modifica- 
tion and alteration within the spirit and scope of the 
appended claims. The description is thus to be regarded as 
illustrative instead of limiting on the invention. 

What is claimed is: 

1. A method for providing a user interface, said user 
interface providing functionality for processing a time-based 
media, said method comprising: 

detecting input to change a portion of said graphical user 
interface being displayed, wherein said portion indi- 
cates time relating to said time-based media, 

determining an input speed of said input to change said 
portion wherein said input comprises a physical motion 
from which said input speed is determined; and 

determining a rate at which to change said portion, said 
rate being dependent on said input speed; and 

changing said portion at said rate by scrolling on a line by 
line basis wherein a line of information is moved off 
said portion and for each said line that is moved off said 
portion, a new line of information is displayed. 

2. The method of claim 1, further comprising: 
storing said time-based media as a QuickTime movie. 

3. The method of claim 2, further comprising: 
storing said time-based media at a remote location acces- 
sible through a data processing network. 

4. The method of claim 2, further comprising: 
storing said lime-based media on a machine-readable 

medium at a local location. 

5. The method of claim 1, further comprising: 
displaying in said portion text information indicating a 

chapter of said time-based media file; and 
in response to said input, scrolling through a plurality of 
chapters at a scroll rate that depends on said input 
speed. 

6. The method of claim 1, wherein said input comprises: 
placing a cursor over said portion; and 

dragging said cursor in a first direction to change the 
display in said portion. 

7. The method of claim 1, wherein said time-based media 
file comprises one of video data, audio data, visual data, and 
a combination of audio and video data. 
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8. The method of claim 1, further comprising: 
displaying in said portion a time bar that indicates time in 

said time-based media. 

9. The method of claim 8, further comprising: 

5 using at least one display select marker to select a range 
of time on said time bar, said range of time correspond- 
ing to a range of time in said time-based media. 

10. A machine readable medium having stored thereon 
executable code which causes a machine to perform a 

10 method for generating a user interface, said user interface to 
provide functionality for processing time-based media data, 
said method comprising: 

detecting input to change a portion of said graphical user 
interface that indicates time relating to said time-based 
media; 

determining an input speed of said input to change said 
portion wherein said input comprises a physical motion 
from which said input speed is determined; 

20 determining a rate at which to change said portion, said 
rate being dependent on said input speed; and 
changing said portion at said rate by scrolling on a line by 
line basis wherein a line of information displayed in 
said portion is moved off said portion and for each said 

25 line that is moved off said portion, a new line of 
information is displayed. 

11. The machine readable medium of claim 10, wherein 
said method further comprises: 

storing said time-based media as a QuickTime movie. 
30 12. The machine readable medium of claim 11, wherein 
said method further comprises: 

storing said time-based media at a remote location acces- 
sible through a data processing network. 

13. The machine readable medium of claim 11, wherein • 
35 said method further comprises: 

storing said time-based media on a machine-readable 
medium at a local location. 

14. The machine readable medium of claim 10, wherein 
said method further comprises: 

40 displaying text information indicating a chapter of said 

time-based media file; and 
in response to said input, scrolling through a plurality of 

chapters at a scroll rate that depends on said input 
45 speed. 

15. The machine readable medium of claim 10, wherein 
said method further comprises: 

placing a cursor over said portion; and 
dragging said cursor in a first direction to change said 
50 information displayed in said portion at said rate. 

16. The machine readable medium of claim 10, wherein 
said time-based media file comprises one of video data, 
audio data, and a combination of audio and video data. 

17. The machine readable medium of claim 10, wherein 
55 said method further comprises: 

displaying a time bar that indicates time in said time- 
based media. 

18. The machine readable medium of claim 17, wherein 
said method further comprises: 

60 using at least one display select marker to select a range 
of time on said time bar, said range of time correspond- 
ing to a range of time in said time-based media. 

19. An apparatus for generating a user interface, said user 
interface to provide functionality for processing time-based 

65 media data, said apparatus comprising: 

a first means for detecting input to change a portion of 
said graphical user interface being displayed, wherein 
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said portion indicates time relating to said time-based 
media; 

a second means for determining an input speed of said 
input to change said portion wherein said input com- 
prises a physical motion from which said input speed is 
determined; and 

a third means for determining a rate at which to change 
said portion, said rate being dependent on said input 
speed; and 

a fourth means for changing said portion at said rate by 
scrolling on a line by line basis wherein a line of 
information displayed in said portion is moved off said 
portion and for each said line that is moved off said 
portion, a new line of information is displayed. 

20. The apparatus of claim 19, further comprising: 

a storing means for storing said time-based media as a 
QuickTime movie. 

21. The apparatus of claim 20, wherein said storing means 
is for storing said time-based media at a remote location 
accessible through a data processing network. 

22. The apparatus of claim 20, further comprising: 

a machine-readable medium storing means for storing 
said time-based media at a local location. 
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23. The apparatus of claim 19, further comprising: 

a fifth means for displaying in said portion text informa- 
tion indicating a chapter of said time-based media file; 
and 

a sixth means for scrolling through a plurality of chapters 
at a scroll rate that depends on said input speed. 

24. The apparatus of claim 19, further comprising: 

a cursor control means for placing a cursor over said 
portion; and 

said cursor control means further for allowing dragging 
said cursor in a first direction to change the display in 
said portion. 

25. The apparatus of claim 19, wherein said time-based 
media comprises one of video data, audio data, visual data, 
and a combination of audio and video data. 

26. The method of claim 19, further comprising: 

a fifth means for displaying in said portion a time bar that 
indicates time in said time-based media. 

27. The method of claim 26, further comprising: 

a select marker means for selecting a range of time on said 
time bar, said range of time corresponding to a range of 
time in said time-based media. 
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